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Abstract 

Chaotic iterations have been introduced on the one hand by Chazan, Mi- 
ranker [S] and MieUou [TU] in a numerical analysis context, and on the other 
hand by Robert [12\ and Pellegrin [llj in the discrete dynamical systems frame- 
work. In both cases, the objective was to derive conditions of convergence of 
such iterations to a fixed state. In this paper, a new point of view is presented, 
the goal here is to derive conditions under which chaotic iterations admit a 
chaotic behaviour in a rigorous mathematical sense. Contrary to what has been 
studied in the literature, convergence is not desired. 

More precisely, we establish in this paper a link between the concept of 
chaotic iterations on a finite set and the notion of topological chaos [S] , [7] , [5] . 
We are motivated by concrete applications of our approach, such as the use of 
chaotic boolean iterations in the computer security field. Indeed, the concept 
of chaos is used in many areas of data security without real rigorous theoretical 
foundations, and without using the fundamental properties that allow chaos. 
The wish of this paper is to bring a bit more mathematical rigour in this field. 
This paper is an extension of 3], and a work in progress. 

1 Introduction 

Let us consider the system = {0; 1}^, in which each of the two cells Ci is 
caracterized by a boolean state e^. An evolution rule is, for example, 

/ : B2 — > B2 

(61,62) I — > (ei-l-e^,eT) 



These cells can be updated in a serial mode (the elements are iterated in a 
sequential mode, at each time only one element is iterated), in a parallel mode 
(at each time, all the elements are iterated), or by following a sequence (S'")„g]N: 
the n}^ term 5" is constituted by the block components to be updated at the 
n*'' iteration. This is the chaotic iterations, and S is called the strategy. Let us 
notice that serial and parallel modes are particular cases of chaotic iterations. 
Until now, only the conditions of convergence have been studied. 
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A priori, the chaotic adjective means "in a disorder way" , and has nothing to 
do with the mathematical theory of chaos, studied by Li-Yorke [5], Devaney [7], 
Knudsen ^, etc. We asked ourselves what it really was. 

In this paper we study the topological evolution of a system during chaotic 
iterations. To do so, chaotic iterations have been written in the field of discrete 
dynamical system: 



where {X, d) is a metric space (for a distance to be defined), and / is continuous. 

Thus, it becomes possible to study the topology of chaotic iterations. More 
exactly, the question: "Are the chaotic iterations a topological chaos ?" has 
been raised. 

This study is the first of a series we intend to carry out. We think that 
the mathematical framework in which we are placed offers interesting new tools 
allowing the conception, the comparison and the evaluation of new algorithms 
where disorder, hazard or unpredictability are to be considered. 

The rest of the paper is organised as follows. 
The first next section is devoted to some recalls on the domain of topological 
chaos and the domain of discrete chaotic iterations. In third section is defined 
the framework of our study. Fourth section presents the first results concerning 
the topology (compacity) of the chaotic iterations. Fifth and sixth sections 
constitute the study of the chaotic behaviour of such iterations. In section [7l 
the computer and so the finite set of machine numbers is considered. The paper 
ends with some discussions and future work. 

2 Basic recalls 

This section is devoted to basic notations and terminologies in the fields of 
topological chaos and chaotic iterations. 

2.1 Chaotic iterations 

In the sequel S*" denotes the n*'' term of a sequence S, Vi denotes the i*^ 
component of a vector V, and f'^ = / o ... o / denotes the k*^ composition of a 
function /. Finally, the following notation is used: Jl; NJ = {1,2,..., N}. 

Let us consider a system of a finite number N of cells, so that each cell has 
a boolean state. Then a sequence of length N of boolean states of the cells 
corresponds to a particular state of the system. 

A strategy corresponds to a sequence S* of [I; N]. The set of all strategies is 
denoted by S. 

Definition 1 Let 5 G §. The shift function is defined by 




('5'")ne]N 
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and the initial function is the map which associates to a sequence, its first term 

i: § ^ [1;N1 
(S'")„giN I — > 5°. 

The set B denoting {0, 1}, let / : — > B^ be a function, and 5 G § be a 
strategy. Then, the so called chaotic iterations are defined by 



^n-i if S"* ^ i (1) 

{fix-))s. if = I. 



Vn e W,\Ji e [l;Nl,xf = 



In other words, at the n*'* iteration, only the iS"— th cell is "iterated". Note 
that in a more general formulation, 5'" can be a subset of components, and 
/(a;") Sr. can be replaced by f{x^)s"', where k ^ n, modelizing for example delay 
transmission (see e.g. [2]). For the general definition of such chaotic iterations, 
see, e.g. [12]. 

2.2 Chaotic properties of dynamical systems 

Consider a metric space {X, d), and a continuous function / : X — > X. 

Definition 2 / is said to be topologically transitive if, for any pair of open sets 
U,V C X, there exists fc > such that /'=([/) nV ^ 0. 

Definition 3 {X, /) is said to be regular if the set of periodic points is dense 
in X. 

Definition 4 / has sensitive dependence on initial conditions if there exists 
5 > such that, for any x £ X and any neighbourhood V of x, there exists 
y eV and n ^ such that - /"(y)! > S. 

S is called the constant of sensitivity of /. 

Definition 5 / is said to have the property of expansivity if 

3e >0,yx^ y, 3n e N, d{f"{x), f^{y)) ^ e. 

Then, e is the constant of expansivity of /. We also say / is e-expansive. 

Remark 1 A function / has a constant of expansivity equals to e if an arbitrary 
small error on any initial condition is amplified till e. 

3 A topological approach for chaotic iterations 

In this section we will put our study in a topological context by defining a 
suitable metric set. 
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3.1 The iteration function and the phase space 

Let us denote by S the discrete boolean metric, 5{x,y) — -i^ x — y, and define 
the function 



Ff : |l;N]xB^ — > 

{k,E) ^ (^E,.S{k,j) + f{E)kI{kJ)) 



where + and . are boolean operations. 
Consider the phase space 

A-^piNrxB^, 

and the map 

Gf{S,E) = ia{S),Ff{t{S),E)) (2) 

Then one can remark that the chaotic iterations defined in ([l]) can be described 
by the following iterations 

X" ex 

The following result can be easily proven, by comparing § and R, 
Theorem 1 The phase space X has the cardinality of the continuum. 
Note that this result is independent on the number of cells. 

3.2 A new distance 

We define a new distance between two points [S, E), {S, E) e X hy 
d{{S, E); {S, E)) - de{E, E) + d,{S, S), 

where 

r N 

de{E,E) = 

d(ss) - '^'v '^'-^'l 

fe=i 

It should be noticed that if the floor function Y)\ = n, then the 

strategies X and Y differs in n cells and that d{X, Y) — [d{X, Y)\ gives a 
measure on how the strategies S and S diverge. More precisely, 

• This floating part is less than 10^'^ if and only if the first fc*'' terms of the 
two strategies are equal. 

• If the fc*'' digit is nonzero, then the fc*'' terms of the two strategies are 
diferent. 
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3.3 The topological framework 

It can be proved that, 

Theorem 2 Gf is continuous on {X,d). 

Proof We use the sequential continuity (we are in a metric space). 

Let {S"" , E")n£fi be a sequence of the phase space X, which converges to 
iS,E). We will prove that (G/(5'", converges to Gf{S,E). Let us 

recall that for all n, 5" is a strategy, thus, we consider a sequence of strategy 
{i.e. a sequence of sequences). 

As d((S'",£;"); (S',^;)) converges to 0, each distance de{E"',E) and ds(5'",5') 
converges to 0. But de{E", E) is an integer, so 3no G IN, de{E^, E) = for any 
n ^ hq. 

In other words, there exists threshold no G W after which no cell will change its 
state: 

3no e IN, n > no =^ = E. 

In addition, ds{S"-, S) — > 0, so 3ni E F, ds{S"-, S) < 10"^ for aU indices greater 
than or equal to ni. This means that for ?i ^ ni, all the S*" have the same first 
term, which is So- 

\/n ^ ni, Sq — Sq. 

Thus, after the TOaa;(no, ni)— th term, states of i?" and E are the same, and 
strategies and S start with the same first term. 

Consequently, states of G f {S'"' , E'"') and Gf{S,E) are equal, then distance d 
between this two points is strictly less than 1 (after the rank 7naa;(no, ni)). 

We now prove that the distance between (G/(S'", i?")) and {Gf{S,Ej) is con- 
vergent to 0. Let e > 0. 

• If £ ^ 1, then we have seen that the distance between (G/(S'", i?")) and 
{Gf{S, E)) is strictly less than 1 after the max{no, ni)*-^ term (same state). 

• If £ < 1, then 3k e IN, IQ-*^ ^ £ ^ IQ-^'^+'^'K But ds{S'\S) converges to 
0, so 

3n2 e F,Vn ^ n2,4(5'",S') < lO^^''+^\ 
after n2, the k + 2 first terms of 5" and S are equal. 

As a consequence, the fc + 1 first entries of the strategies of Gf{S'^,E'") and 
Gf{S,E) are the same (because G/ is a shift of strategies), and due to the 
definition of ds, the floating part of the distance between (^'^i?") and {S,E) 
is strictly less than 10^^^+^) ^ e. 

In conclusion, G/ is continuous, 

V£ > 0,3Nq = maa;(no,ni,n2) £ ]N,Vn ^ NQ,d{GfiS'\E'');Gf{S,E)) e. 

Then chaotic iterations can be seen as a dynamical system in a topological 
space. In the next section, we will study the compacity of such a topological 
space, with a view to prove the expansive chaos in section [6.31 
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4 Compacity 

To prove that {X, Gf) is a compact topological space, we have to check whether 
it is separate or not. Then, the sequential characterisation of the compacity for 
the metric spaces will be used to obtain the result. 

4.1 Sepeirated spaces 

This section starts with some basic recalls... 

Definition 6 A topological space {X,t) is said to be a separated space if for 
any points x ^ y € X, there exist two open sets u^, ojy such that x G u)x,y & i^y 
and UxPiiVy = 0. 

Theorem 3 {X,Gf) is a separated space. 
Proof Let {E,S) ^ (E,S). 

1. If E ^ E, then the intersection between the two balls B ({E,S), ^) and 
s((E,S),i) in empty 

2. Else, it exists fc e IN such that S'' ^ s'' , then the balls B {{E, S), 10-('=+i)) 
and B ((E, S), 10-('=+i)) can be chosen. 

4.2 Compact spaces 

Definition 7 A topological space (X, r) is said to be compact if it is a separated 
space, and if each of its open covers has a finite subcover. 

Definition 8 Let {X, r) be a topological space, and A a subset of X. a € Ais 
an accumulation point if yV e Va, V D A ^ 0, and V DA^ {a}. 

Let us now recall the sequential characterisation of the compacity for the 
metric spaces: 

Theorem 4 Let {E, d) be a metric space, and K c E. The following properties 
are equivalents: 

1. K is a compact space. 

2. For any sequence of K, it can he possible to extract another sequence which 

converge in K . 

3. Any sequence of K has an adherence value in K. 

4. Any infinite subset of K has an accumulation point in K. 
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4.3 Compacity result 

Theorem 5 {X,d) is a compact metric space. 

Proof First, {X, d) is a separate space. 
Let {E'", S"')nefi be a sequence of X. 

1. A state -B" which appears an infinite number of time in this sequence can 
be found. Let 

7= {(£;", 5'")|£;" = £;"}. 

For all_(£;, S) e /, 5"[0] G [1, N], and / is an infinite set. Then it can be 
found k G [[1, N] such that an infinite number of strategies of / start with 
k. 

Let no be the smahest integer such that = E^ and 5" [0] = k. 

2. The set 

/' = {{E'\ S")\E'" = S"" ct ^"[O] = S'">[0]} 

is infinite, then one of the element of |1, N| will appear an infinite number 
of times in the ^"[l] of /': let us call it 1. 

Let m be the smallest n such that {E"", 5") e /' and = 1. 

3. The set 

/" = = £;"«, 5"[o] = s'"«[o],s"[i] = s"i[i]} 

is infinite, etc. 

Let / = (5n/j[fc])^g][^), then the subsequence (£'"'=,5"'=) converge to /. 

5 Topological chaotic properties 

To prove that we are in the framework of topological chaos, we have to check 
some topological conditions. 

5.1 Regularity 

Theorem 6 Periodic points of Gf are dense in X. 

Proof Let (5, E) e X, and e > 0. We are looking for a periodic point (5', E') 
satisfying d{{S, E); (S", E')) < e. 

We choose E' = E, and we reproduce enough entries from S to S' so that 
the distance between (S", E) and {S, E) is strictly less than e: a number k = 
\logiQ{£)\ + 1 of terms is sufficient. 

After this A:*'' iterations, the new common state is £, and strategy S' is shifted 
of k positions: a''{S'). 

Then we have to complete strategy S' in order to make {E',S') periodic (at 
least for sufficiently large indices). To do so, we put an infinite number of 1 to 
the strategy S'. 

Then, either the first state is conserved after one iteration, so £ is unchanged 
and we obtain a fixed point. Or the first state is not conserved, then: if the first 
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state is not conserved after a second iteration, then we will be again in the first 
case above (due to the fact that a state is a boolean). Otherwise the first state 
is conserved, and we have indeed a fixed (periodic) point. 

Thus, there exists a periodic point into every neighbourhood of any point, 
so {X, Gf) is regular, for any map /. 

5.2 Transitivity 

Contrary to the regularity, the topological transitivity condition is not automat- 
ically satisfied by any function 

(/ = Identity is not topologically transitive). Let us denote by T the set of 
maps / such that {X, Gf) is topologically transitive. 

Theorem 7 T is a nonempty set. 

Proof We will prove that the vectorial logical negation function /o 
/o: 

(a;i, . . . ,a;N) i — > {xT,...,xn) (3) 

is topologically transitive. 

Let Ba = B{XA,rA) and Bb = B{XB,rB) be two open balls of X, where 
Xa = {Sa,Ea), and Xb = {Sb,Eb)- Our goal is to start from a point of Ba 

and to arrive, after some iterations of G/„, in Bb- 

We have to be close to Xa, then the starting state E must be Ea; it remains 
to construct the strategy S. Let 5" = S'^,Vn < no, where no is chosen in such 
a way that (5, Ea) G Ba, and E' be the state of G"°(5a, -B^). 
E' difers from Eb by a finite number of cells ci , . . . , . Let 5"°+" = c„,Vn ^ 
m. Then the state of (S, E) is Eb- 

Last, let 5'"o+ni+n — S'g,Vn ^ n2, where n2 is chosen in such a way that 
G^°~^"'^ {S, E) is at a distance less than tb from {Sb,Eb)- Then, starting from 
a point {S, E) close to Xa, we are close to Xb after no + ni iterations: {X,Gfg) 
is transitive. 

Remark 1 If, in the preceeding proof, the strategy were completed using Sb, 
then it can be proved that there exist a point X close to Xa, and ko € IN, such 
that Gy°(X) = Xb- this property is called strong transitivity- 

Remark 2 The question of the characterisation of T will be discussed in an- 
other paper. 

5.3 Sensitive dependence on initial conditions 

Theorem 8 {X,Gfg) has sensitive dependence on initial conditions, and its 
constant of sensitiveness is equal to N . 

Proof Let (S, E) e X, and S > 0. A new point {S', E') is defined by: E' = E, 
gin = 5""^ Vn < no, where no is chosen in such a way that d{{S, E); (S", £")) < 5, 
and 5""°+'= = k,^k€ 

Then the point {S',E') is as close as we want than {S,E), and systems of 
G'^^^{S,E) and G'^^^{S',E') have no cell presenting the same state: distance 
between this two points is greater or equal than N. 
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Remark 2 This sensitive dependence could be stated as a consequence of reg- 
ularity and transitivity (by using the theorem of Banks [.4j). However, we have 
preferred proving this result independently of regularity, because the notion of 
regularity must be redefined in the context of the finite set of machine numbers 
(see section Fr2|) . 

5.4 Expansivity 

Theorem 9 {X,Gfg) is an expansive chaotic system. Its constant of expansiv- 
ity is equal to 1. 

Proof If {S,E) ^ {S;E), then: 

• Either E E, and then at least one cell is not in the same state in E and 
E. Then the distance between (5*, E) and (S; E) is greater or equal to 1. 

• Or E = E. Then the strategies S and S are not equal. Let no be the first 
index in which the terms S and S difer. Then 

Vk<no,G]°{S,E)^G%{S,E), 

and G^iS^E) ^ G^iS^E), then as E = E, the cell which has changed 
in E at the riQ-th iterate is not the same than the cell which has changed 
in E, so the distance between G^° {S, E) and G^^ (S*, E) is greater or equal 
to 2. 

Remark 3 It can be easily proved that (A',G/q) is not A-expansive, for any 
A>1. 

In the next section, we will show that chaotic iterations are a case of topo- 
logical chaos, in the sense of Knudsen, Devaney [7j and expansion. 

6 Discrete chaotic iterations and topological chaos 
6.1 Knudsen's chaos 

Definition 9 A discrete dynamical system is said to be K -chaotic if: 

1. it possesses a dense orbit, 

2. it has sensitive dependence on initial conditions. 

Theorem 10 If X is a compact space, then being regular and transitive implies 
being K -chaotic. 

Theorem 11 {X,Gf) is chaotic in the sense of Knudsen, V/ G T. 

Proof X is a. compact space, and {X,Gf) is regular and transitive, then 
{X,Gf) is if-chaotic. 
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6.2 Devaney's chaos 

Let us recall the definition of a chaotic topological system, in the sense of De- 
vaney [7j: 

Definition 10 f : X — > X is said to be D— chaotic on X if {X, /) is regular, 
topologically transitive, and has sensitive dependence on initial conditions. 

If / S T, then {X, G/) is topologically transitive, regular and has sensitive 
dependence on initial conditions. Then we have the result. 

Theorem 12 V/ G T ^ 0, Gf is a chaotic map on {X,d) in the sense of 
Devaney. 

6.3 Expansive chaos 

Definition 11 A discrete dynamical system is said to be E-chaotic if it has 
transitive, regular and expansive properties. 

Theorem 13 V/ £ T, {X,Gf) is E-chaotic. 

Proof {X,Gf) is Z?-chaotic, and has the expansive property, then {X,Gf) is 
i?-chaotic. 

We have proven that under the transitivity condition of /, chaotic iterations 
generated by / can be described by a chaotic map on a topological space in 
diferent senses. 

We have considered a finite set of states B'^ and a set S of strategies composed 
by an infinite number of infinite sequences. In the following section we will 
discuss the impact of these assumptions in the context of the finite set of machine 
numbers. 

6.4 Topological entropy 
6.4.1 Recalls 

Let (X, d) be a compact metric space and / : XX be a continuous map. For 
each natural number a new metric d„ is defined on X by 



Given any e > and n ^ 1, two points of X are e-close with respect to this 
metric if their first n iterates are e-close. 

This metric allows one to distinguish in a neighborhood of an orbit the points 
that move away from each other during the iteration from the points that travel 
together. A subset i? of X is said to be (n, £)-separated if each pair of distinct 
points of E is at least e apart in the metric dn- Denote by H(n, s) the maximum 
cardinality of an (n, £)-separated set. 

Definition 12 The topological entropy of the map f is defined by (see e.g. [T] 



dn{x,y) 



maxMr(a;),f (y)) :0<z<n}. 



or 0) 



h{f) — hm I hmsup — logi?(n, e) 
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6.4.2 Result 

Theorem 14 Entropy of{X,Gf) is infinite. 

Proof Let E, E e such that 3io e |1, iV], E,„ ^ E.^. Then, VS, S G 5, 



But the cardinal c of 5 is infinite, then Vti S N, c > e" . 

Then for all n e N, the maximal number H{n, 1) of (n, 1)— separated points 

2 

is greater than or equal to e" , so 



We have proven that it is possible to find /, such that chaotic iterations 
generated by / can be described by a chaotic and entropic map on a topological 
space in the sense of Devaney. We have considered a finite set of states and 
a set § of strategies composed by an infinite number of infinite sequences. In the 
following section we will discuss the impact of these assumptions in the context 
of the finite set of machine numbers. 

7 The case of finite strategies 
7.1 A new definition for the periodicity 

In the computer science framework, we also have to deal with a finite set of 
states of the form B'^ and the set § of sequences of [1; N] is infinite (countable), 
so in practice the set X is also infinite. The only diference with respect to the 
theoretical study comes from the fact that the sequences of S are of finite but 
not fixed length in the practice. 

The proof of the continuity, the transitivity and the sensitivity conditions are 
independent of the finitude of the length of strategies (sequences of §) , so even 
in the case of finite machine numbers, we have the two fundamental properties 
of chaos: sensitivity and transitivity, which respectively implies unpredictability 
and indecomposability (see [7], p. 50). The regularity property has no meaning 
in the case of finite systems because of the notion of periodicity. 
We propose a new definition in order to bypass the notion of periodicity in 
practice. 

Definition 13 A strategy 5 = (S*^, S*^) is said cj/cZic if a subset of successive 
terms is repeated from a given rank, until the end of S. A point of X that admits 
a cyclic strategy is called a cyclic point. 

For example, 



d((E,S);(E,S))^l 



2 




htop (G/) = hm htop{Gf,e) > htop{Gf, 1) = +oo 



• (1, 3, 2, 4, 1, 2, 1, 2) and (1, 3, 2, 4, 1, 2, 2, 2) are cyclic, 
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• but (1, 3, 2, 4, 1, 2) and (1, 3, 2, 1, 3) are not cyclic. 

This definition can be interpreted as the analogous of periodicity on finite 
sets. 

Then, following the proof of regularity (section 15. ip , it can be proved that the 
set of cyclic points is dense on X, hence obtaining a desired element of regularity 
in finite sets, as quoted by Devaney ([7|, p. 50): two points arbitrary close to 
each other could have diferent behaviours, the one could have a cyclic behaviour 
as long as the system iterates while the trajectory of the second could "visit" 
the whole phase space. 

It should be recalled that the regularity was introduced by Devaney in order 
to counteract the transitivity and to obtain such a property: two points close 
to each other can have fundamental diferent behaviours. 

7.2 How it is concreatly possible to deal with infinite length 
strategies 

It is worthwhile to notice that even if the set of 
machine numbers is finite, we deal with strategies 
that have a finite but unbounded length. Indeed, it 
is not necessary to store all the terms of the strat- 
egy in the memory, only the n*'* term (an integer 
less than or equal to N) of the strategy has to be 
stored at the n*'' step, as it is illustrated in the fol- 
lowing example. 

Let us suppose that a given text is input from 
the outside world in the computer character by char- 
acter, and that the current term of the strategy is 
given by the ASCII code of the current stored char- 
acter. Then, as the set of all possible texts of the 
outside world is infinite and the number of their 
characters is unbounded, we have to deal with an 
infinite set of finite but unbounded strategies. 

Of course, the preceding example is a simplistic illustrating example. A 
chaotic procedure should to be introduced to generate the terms of the strategy 
from the stream of characters. 

In conclusion, even in the computer science framework our previous theory 
applies. 

8 Discussion and future work 

We proved that discrete chaotic iterations are a particular case of topological 
chaos, in sense of Devaney, Knudsen and expansivity, if the iteration function 
is topologically transitive, and that the set of topologically transitive functions 
is non void. 
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This theory has a lot of apphcations, because of the high number of situations 
that can be described with the chaotic iterations: neural networks, cellular 
automata, multi-processor computing, , and so on. If this system is requested to 
evolve in an apparently disorderly manner, e.g. for security reasons (encryption, 
watermarking, pseudo-random number generation, hash functions, etc.), our 
results could be useful. 

More concretely, for example, any medium (text, image, video, etc.) can 
be considered to be an agregation of elementary cells (respectively: character, 
pixel, image) . Thus a digital watermarking of this medium can be describe as an 
insertion of cells of a watermark into some cells of a carrier image (the state of 
the system) , in a deterministic but unpredictable manner carried by a strategy. 

Moreover, the theory brings another way to compare two given algorithms 
concerned by disorder (evaluation of theirs constants of sensitivity, expansivity, 
etc.), which can be seen as a complement of existing statistical evaluations. 

In future work, other forms of chaos (such as Li- York chaos [9]) will be stud- 
ied, other quantitative and qualitative tools such as entropy (see e.g. [T] or [5]) 
will be explored, and the domain of applications of our theoretical concepts will 
be enlarged. 
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